Deep Learning Compatible Differentiable X-ray Projections for Inverse Rendering
نویسندگان
چکیده
Many minimally invasive interventional procedures still rely on 2D fluoroscopic imaging. Generating a patient-specific 3D model from these X-ray data would improve the procedural workflow, e.g., by providing assistance functions such as automatic positioning. To accomplish this, two things are required. First, statistical human shape of anatomy and second, differentiable renderer. We propose renderer deriving distance travelled ray inside mesh structures to generate map. demonstrate its functioning, we use it for simulating images models. Then show application solving inverse problem, namely reconstructing models real fluoroscopy pelvis, which is an ideal anatomical structure patient registration. This accomplished iterative optimization strategy using gradient descent. With majority pelvis being in field view, achieve mean Hausdorff 30mm between reconstructed ground truth segmentation.
منابع مشابه
Compatible Reward Inverse Reinforcement Learning
PROBLEM • Inverse Reinforcement Learning (IRL) problem: recover a reward function explaining a set of expert’s demonstrations. • Advantages of IRL over Behavioral Cloning (BC): – Transferability of the reward. • Issues with some IRL methods: – How to build the features for the reward function? – How to select a reward function among all the optimal ones? – What if no access to the environment? ...
متن کاملDeep Structure for end-to-end inverse rendering
Inverse rendering in a 3D format denoted to recovering the 3D properties of a scene given 2D input image(s) and is typically done using 3D Morphable Model (3DMM) based methods from single view images. These models formulate each face as a weighted combination of some basis vectors extracted from the training data. In this paper a deep framework is proposed in which the coefficients and basis ve...
متن کاملA Differentiable Physics Engine for Deep Learning in Robotics
One of the most important fields in robotics is the optimization of controllers. Currently, robots are often treated as a black box in this optimization process, which is the reason why derivative-free optimization methods such as evolutionary algorithms or reinforcement learning are omnipresent. When gradient-based methods are used, models are kept small or rely on finite difference approximat...
متن کاملWavelet Projections for Volume Rendering
We extended Gross’s 3 method of volume wavelet rendering by computing splats via an orthogonal projection operator. The method decomposes the volume data into a wavelet pyramid representation in the spline domain. The splats of the basis functions are approximated on a multiresolution grid. Using least-squares approximation ensures the smallest possible error for a given sampling step size. The...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Informatik aktuell
سال: 2021
ISSN: ['2628-8958', '1431-472X']
DOI: https://doi.org/10.1007/978-3-658-33198-6_70